Papers with meta-knowledge contamination
Beyond Self-Reports: Multi-Observer Agents for Personality Assessment in Large Language Models (2025.findings-emnlp)
Copied to clipboard
| Challenge: | Self-report questionnaires are used to assess LLM personality traits, but they fail to capture behavioral nuances due to biases and meta-knowledge contamination. |
| Approach: | They propose a multi-observer framework for personality trait assessments in LLM agents that draws on informant-report methods in psychology. |
| Outcome: | The proposed framework combines multiple observers with a subject LLM agent to assess its Big Five personality traits. |